Thermodynamics based on the principle of least abbreviated action: entropy 
production in a network of coupled oscillators 
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We present some novel thermodynamic ideas based on the Maupertuis principle. By considering 
Hamiltonians written in terms of appropriate action-angle variables we show that thermal states 
can be characterized by the action variables and by their evolution in time when the system is 
nonintegrable. We propose dynamical definitions for the equilibrium temperature and entropy as 
well as an expression for the nonequilibrium entropy valid for isolated systems with many degrees 
of freedom. This entropy is shown to increase in the relaxation to equilibrium of macroscopic 
systems with short-range interactions, which constitutes a dynamical justification of the Second 
Law of Thermodynamics. Several examples are worked out to show that this formalism yields the 
right microcanonical (equilibrium) quantities. The relevance of this approach to nonequilibrium 
situations is illustrated with an application to a network of coupled oscillators (Kuramoto model). 
We provide an expression for the entropy production in this system finding that its positive value 
is directly related to dissipation at the steady state in attaining order through synchronization. 
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I. INTRODUCTION 

Variational principles occupy a privileged place in the 
history of physics. They provide approximate results to 
formidable problems where it is difficult to find analytical 
solutions from other methods The first variational 
principle was established in mechanics by Maupertuis 
(1744). Its interest and importance was later realized 
by Lagrange, who referred to it as the most beautiful and 
important discovery of Mechanics [l| . Thisprinciple led 
to an elegant geometrization of mechanics 0, @] for con- 
servative systems, and had enormous consequences in the 
subsequent development of physics. 

The variational principles of mechanics constituted 
the key idea of the former mechanical approaches to 
thermodynamics. These were first attempted indepen- 
dently by Boltzmann and Clausius and later continued 
by Helmholtz These pioneering works allowed for a 

certain understanding of thermodynamics from mechan- 
ics Q but their importance was later underestimated 
in favour of a statistical interpretation of thermodynam- 
ics. The history of these developments and the confusion 
surrounding Boltzmann ideas have been recently illumi- 
nated by some authors [1, 0, S, i, 0, HH • 

Despite one century of successful results coming from 
the statistical approach, the bridge between microscopic 
dynamics and macroscopic behaviour is still an open is- 
sue. Probabilistic concepts are not only extremely use- 
ful in practical situations but play also a central role 
in laying the microscopic foundations of Thermodynam- 
ics. The following criticism by Einstein to Boltzmann 
(who realized the importance of the statistical approach 



in later works) still holds: the systems considered in 
statistical mechanics are dynamical systems, consisting 
of moving particles [and therefore] the statistical results 
should all be derivable from the dynamics. 

In this article, we present some novel thermodynamic 
ideas which are grounded in the Maupertuis principle 
as well as in the modern general theory of dynamical 
systems. Ergodicity and probability assumptions (phase 
space averaging) are not invoked, and only time averages 
coming from the microscopic mechanics are considered. 
Our approach makes use of Hamiltonians given in terms 
of action-angle variables 
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where (J, 6) = ({ Ji}, {6i]) are vectors containing suitable 
action and angle variables respectively, and Hq and Hi 
are, respectively, the "integrable" and "nonintegrable" 
parts of the Hamiltonian. It is generally possible to con- 
struct such Hamiltonians frorti, for example, mechanical 
variational principles P, Then, we show that 

thermal states can be fully characterized by the action 
variables. When the system is nonintegrable, these vari- 
ables do not need to be adiabatic invariants but the en- 
tropy, defined as a function of them, must not change 
significantly within a period of the oscillation of any de- 
gree of freedom (DOF). 

The outline of the paper is as follows. In Section II we 
introduce the dynamical concepts of equilibrium temper- 
ature, entropy and heat differential. The central concept 
in our approach is the nonequilibrium entropy for a sys- 
tem of many DOFs, which is introduced in Section HI. 
We then link this result to the ones in Section II and a 
natural, dynamical definition of probability arises, yield- 
ing an Einstein relationship at the thermodynamic limit. 
In Section IV we show that entropy attains its maxi- 
mum at equilibrium for macroscopic systems with short- 
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range interactions. This connects resuhs in Sections II 
and III. In Section V we apply this dynamically based 
thermodynamic formalism to several systems of different 
nature: ideal systems (noninteracting oscillators, ideal 
gas) and systems with short and long-range interactions. 
We show how our dynamical definitions correctly repro- 
duce previous equilibrium results obtained from the nii- 
crocanonical ensemble. Finally, in Section VI, we provide 
an application to nonequilibrium stationary states in a 
network of coupled oscillators (Kuramoto model). We 
study the entropy production in this system by means of 
the nonequilibrium theory developed in Sections III and 
IV and illustrate its physical significance. We find that 
the entropy production at the stationary state is directly 
related to dissipation in attaining order far from equi- 
librium through synchronization. Numerical calculations 
are performed to clarify this result. 



II. EQUILIBRIUM DYNAMICAL 
TEMPERATURE AND ENTROPY 

In the prehistory of Statistical Mechanics (i.e. before 
the introduction of any probabilistic concept) Boltzmann 
provided a mechanical foundation of thermodynamics for 
monocyclic systems with only one DOF 0, [13] . The con- 
stant energy trajectories in phase space of these systems 
(e.g. a single harmonic oscillator) were bounded, peri- 
odic orbits, and Boltzmann defined heat as the energy 
difference between two orbits. Then he introduced a dy- 
namical temperature and proved that its reciprocal is an 
integrating factor for the heat differential, which allowed 
him to identify the entropy of the system. In this arti- 
cle we follow a different path inspired in the Maupertuis 
principle. Our approach is valid for / DOFs and reduces 
to Boltzmann's theory for / = 1. 

Consider a system whose Hamiltonian H{q,p,t) de- 
pends on time t and generalized position coordi- 
nates q(i) — {qi{t), ...,qf{t)) and momenta p{t) = 
(pi(i), ...,p/(t)) — VqA, where / is the number of DOFs. 
The Hamilton-Jacobi equation reads then 



at 



-f ff(q,p,i) = 



(2) 



where A — J Ldt is the Lagrangian action and L is the 
Lagrangian of the system. For conservative systems, H — 
E = const. ^ action can be varied with respect to the time 
r of the trajectory and the following equation is satisfied 



i 



5 A + ESt = {) 



(3) 



Since time can be separated in the Hamilton-Jacobi equa- 
tion, after integration we obtain A = Je ^ Et where 
Je = J^^ pdq is the abbreviated action. The Mauper- 
tuis principle of classical mechanics states that the ab- 
breviated action Je of the trajectory of the motion is an 
extremum over all possible energy- conserving trajectories 



that pass through ending points Qq and in an arbitrary 
time T 3. 

From the total variation of the action bA = ^^5E — 
t5E — ESt, and Eq. wc have 

OJe ^ 
dE 

In the case of closed orbits this equation is written as 

dJc _ 
dE 



(4) 



(5) 



where — (f pdq is the abbreviated action of a closed 
orbit and Tc is the (Poincare) time needed for its com- 
pletion. It is then clear that the product of Jc and the 
recurrence frequency lUc = 1 /tc has dimensions of energy. 
We define the dynamical equilibrium temperature as 



rp(eq) 



LUcJc 

Ik 



(6) 



where k is the Boltzmann constant. A similar definition 
was introduced by Boltzmann for the case f — 1 (see 
3, p. 419). Since Jc is an invariant of the motion and 
does not depend on the choice of coordinates [1], the 
equilibrium temperature does not depend on this choice 
either. 

The dynamical definition of the equilibrium entropy 
jg introduced so that the thermodynamic equation 
dS'-^i^/dE = l/r^'^?) is satisfied. Since Eqs.® and Eq. 
© lead to 



fk 



9 In Jc 
dE 



1 



rp(eq) 



(7) 



the equilibrium entropy 5'*^'^''^ is defined as 

S^^'i^ = fk\n{aJc) (8) 

where a is an integration constant with dimensions of 
inverse action (in the following we take a as unity) . Con- 
sistently, the heat differential is defined as 



dQ = LUcdJc 



(9) 



which represents the variation of energy involved in 
changing the action on the closed trajectory. Thus, it 
is satisfied that l/T^'^'^-' is an integrating factor for the 
heat differential, dQ = T^'"i> dS^^'i\ 

These thermodynamic expressions are useful if we are 
able to calculate Jc from the microscopic dynamics. For 
systems with f ~ I and bounded orbits this is always 
possible since the Hamiltonian is integrable. The con- 
stant energy E can then be directly related to Jc. For 
systems with many DOFs, ergodic theory has provided 
the means for calculating Jc. This theory establishes the 
equality between time averages and phase space aver- 
ages under certain conditions and the Birkhoff theorem. 
Our approach does not require ergodicity but leads to 
the same results if Birkhoff theorem holds, as shown in 
Appendix A. 
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III. NONEQUILIBRIUM ENTROPY 

To extend the formalism to nonequilibrium systems 
with many DOFs, we write the Hamiltonian as in Eq. 

by means of an appropriate canonical transforma- 
tion. This yields a set of action-angle variables (J, 6) 
whose evolution is then considered. The term Hi in Eq. 
(fT|) does not come from a perturbation expansion and it 
is not necessarily smaller than Hq. Hi is associated to 
energy exchange between DOFs in the form of heat. In 
that case the J^'s are neither adiabatic invariants nor con- 
stants of the motion but suitable generalized coordinates 
with dimensions of action. These action-angle variables 
are to be understood as effective ones, coming from ap- 
proximations consistent with the dynamics of the Hamil- 
tonian under consideration (a criterion to be satisfied for 
appropriate action variables is given below). Since each 
DOF oscillates periodically with its effective frequency, 
it is physically meaningful to consider the action Ji of 
the DOF i on its closed cycle with the understanding 
that this cycle can be completed by the DOF going back 
and forth following the Hill's region (i.e. the region in 
configuration space to which the DOF is confined) until 
it reaches its initial angle. Only in the limit of vanish- 
ing Hi are the action variables adiabatic invariants also: 
they correspond to the integrable part of the Hamilto- 
nian and solve exactly the integrable dynamics. This 
kind of representations is used in plasma phy sics and can 
be constructed for general Hamiltonians '16|. 

We define the "temperature" and "entropy" of the 
DOF i as 



UJiJi 



Sj = kin J, 



(10) 



(11) 



so that the thermodynamic formalism for one DOF re- 
sembles that for the whole system. The energy of each 
DOF Ei {i = 1, ... ,/) can vary subject to the constraint 
that the total energy E = 'J2i=i constant, and it 
is satisfied that dSi/dsi = l/T^. These definitions are 
reasonable because Eqs. ^ and ^ apply to any me- 
chanical system, regardless of its size, and each DOF 
in the Hamiltonian behaves as a "system" with energy 
Ei. However, contrarily to the many-DOF system for 
which the total energy E is a. constant, each DOF usu- 
ally exchanges energy with the others (provided that Hi 
in Eq. ([T]) is nonvanishing and the DOFs are separated in 
Ho). The energy Ei is to be understood as a time average 
on the Hill's region in which the DOF moves. This is 
clear from the Hamilton- Jacobi equation, which can be 
applied both to the composite system and to each DOF 
separately with the understanding that, in the latter case, 
each DOF behaves as a system exchanging energy with 
the others and its energy is, therefore, a time average. 

The entropy of one DOF, Eq. pTjl can of course change 
with time but to be physically meaningful it must not 



change significantly during one period = l/w; of the 
oscilation of the DOF i. The DOF i has explored its 
whole available Hill region only after completing a period. 
The entropy of one DOF is defined in terms of the whole 
available Hill region at a given time t and it would be 
inconsistent not to have an almost constant value of this 
quantity within one period of the oscillation. This leads 
to stablish a criterion on the suitability of the action 
variables which, as pointed out above, need not to be 
adiabatic invariants. The condition to be satisfied comes 
from expanding the entropy of a DOF Si in a time t + Ti 
respect to its value at time t. Keeping only linear terms 
in Tj we have 



S^{t^ 



Sr{t) 



1 



dS,{t) 



S,{t) dt 



(12) 



The action variables are appropriate when the absolute 
value of the second term in the r.h.s of Eq. (fT^ is much 
lower than unity. This implies 



-In In Ji 

uji dt 



« 1 



(13) 



If the action variables Ji are adiabatic invariants this cri- 
terion is automatically (and in the best way) satisfied. 
But this is only a sufficient condition and not a neces- 
sary one. Given any Hamiltonian in action-angle vari- 
ables, the criterion in Eq. (|13p can be applied to decide 
if the action variables are appropriate or if a canonical 
transformation to find a better set of variables is needed. 
If this condition is met, the temperature of one DOF is 
also well defined from Eq. (fTO|) 



(14) 



1 dlnJi 



dH 



It is to be noted that action variables bear geomet- 
ric properties of the phase space in the large [13 • This 
can be seen in the fact that in obtaining the action vari- 
able Ji = § Pidqi the momentum of the i-th DOF pi is 
integrated on a closed domain in configuration space in- 
volving the coordinate position q^. This closed domain 
(a 'monocycle') in qi is the definition of Hill's region of 
DOF i. The Hill's region can be a macroscopic object 
and, therefore, action variables connect in this way the 
micro- and macroscales: The former one is suggested by 
the fact that we address each DOF separately; the lat- 
ter comes in the distance over which the DOF moves, an 
information contained in its action variable. In a compli- 
cated problem, any assumption made in approximating 
action variables is connected to an assumption on how the 
trajectory fills the available phase space. This is of spe- 
cial relevance for the Second Law (discussed in the next 
section) to hold since a nonvanishing Hi in Eq. ([T|) is 
then required. This in turn implies that the action-angle 
variables considered are already 'effective' i.e. 'approxi- 
mate' ones (the exact action-angle variables would make 
the Hamiltonian independent of angle variables, the sys- 
tem being integrable). A nonvanishing Hi in the action- 
angle representation is necessary to get relaxation to 
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equilibrium coming from the thermalization of the DOFs. 
This term exist because of, for example, having interac- 
tions between many DOFs that make the system non- 
integrable. The coarse-graining procedure as employed 
in the foundations of standard Statistical Mechanics can 
be also thought as contained in a particular assumption 
made on the action variables: the one sketched in Ap- 
pendix A in which every possible point in phase space 
is equally visited and distributed over the Hill's regions 
of all DOFs. Under such an approximation the dynami- 
cal trajectory is a one-cycle permutation of all attainable 
points (or 'micro states') in phase space. This allows to 
speak about a phase space volume instead of a dynami- 
cal trajectory and to introduce well-behaved probability 
distributions related to 'densities' of occupancy of the 
phase space. In [l8|] this and other assumptions leading to 
different Statistical Mechanics formalisms are discussed 
from a different (but closely related) viewpoint. Com- 
mon to both lines of reasoning in [Tsl and here is that for 
the possibility of providing sound equilibrium statistical 
arguments motivated by the dynamics, the system tra- 
jectory should be long enough in order to approximate 
the volume of phase space in which it is contained. 

A situation of upmost interest occurs when the total 
energy is equally shared by all DOFs of the system, so 
that Ei = e^'^'^^ = E/f for every DOF. In this case, the 
temperature of every DOF is equal to the equilibrium 
temperature of the system defined by Eq.®, Ti — T'^'^''\ 
This equilibrium state of the system is characterized by 
the conditions Ti = T^*^') and Jc^^c finite. In relation to 
the latter condition, it must be noticed that uJc can be 
vanishingly small for macroscopic systems but then is 
large. Thus, in an equilibrium state it is satisfied that 
Jc^c — fkT^'^''^ — Ji^i ^^^d therefore 



/ 



JkT 



dE 



i=l 



i=l 



dE 



(15) 



This provides the energetic equation of the system. 

In a nonequilibrium state, however, the temperatures 
and energies of each DOF are different. The nonequilib- 
rium entropy of the system in such cases is 



(16) 



4=1 



It depends on each through the action variables. This 
entropy corresponds to an open segment on the closed 

trajectory with abbreviated action J'^ = I Y[i=i Ji ] j 
and the last equality in Eq. makes this explicit. It 
is worth noting that Eas. (fTT|) and coincide with Eq. 
([8]) when the system has only one DOF. The same applies 
to temperatures defined by Eqs. © and pU|) . 
For a closed trajectory it is satisfied that 



pqdt ^<2K >r^ 



(17) 



where K is the kinetic energy. (It may be remembered 
that the condition SJe — leads to the equation of the 
geodesies of the Jacobi metric gij = 2KSij Q.) A seg- 
ment of the closed trajectory is said to be typical if 

1 

< 2K >r^ - / pqdt =< 2K >r = fkT'^^1^ (18) 



where r is the duration of the segment (in all what follows 
T must be understood as a much longer time than the 
period of the slowest DOF i). Therefore, the nonequi- 
librium entropy for a typical segment is equal to the equi- 
librium entropy, and this opens the possibility of defining 
the equilibrium thermodynamic variables in terms of the 
action over a typical segment rather than in terms of the 
action over the whole closed (macro)trajectory, as done 
in the previous section. That is, we can consider that 
at equilibrium the system moves along typical segments. 
These considerations are further explored in Appendix 
B. In relation to this, it is remarkable that the existence 
of an equilibrium state implies, from Eqs. ([5]) and (fT^ 



lim 

t^Tr<Tc 



f 



(19) 



where is the relaxation time. That is, if the system has 
a state of thermodynamic equilibrium it attains this state 
after a time Tr lower than t^. This suggests that the lower 
is Tr ( compared to Tc) the more accurate is the description 
of the equilibrium state in terms of typical segments. This 
is because departures from equilibrium are then short 
and, therefore, the closed trajectory contains a higher 
number of typical segments. 

Since we can use Eq. (|16p also to deal with equilibrium 
situations provided we address typical segments, action 
variables illuminate first-order equilibrium phase transi- 
tions involving a discontinuous change in the entropy. If 
we think on a Lennard- Jones fluid, for example, the Hill's 
region of a DOF of a bound particle changes discontin- 
uously when changing (continuously) the total energy of 
the particle from E < to E > 0. In the former situa- 
tion, the Hill's region is bounded by the attractive region 
of the potential. In the latter one, the Hill's region is 
bounded by the macroscopic volume where the fluid is 
contained. This signals the transition from a liquid to a 
gas state, involving a discontinuity on the value of the 
action variables of many DOFs (since their energy is var- 
ied continuosly but their Hill's regions change abruptly) 
and, therefore, a discontinuity on the entropy, Eq. (jl6p . 

The probability ^(7) that the system can be found in 
a given segment 7 [i.e. a piece of micro-trajectory on the 
closed (macro)trajectory] is given by the ratio between its 
duration r and the total duration of the closed trajectory 



^^(7) = - 

Tr 



dJh/dE _ 1 dS{^)ldE si^^f^ 



(20) 



dJc/dE fk dJc/dE 

where S is the nonequilibrium entropy in the segment. If 
we ask for the probability of measuring certain macrovari- 
ables (as T'^'i) during a finite measurement time, it is clear 
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from the above that this is given by P(7i IJ 72... IJ 7n) = 
P{7i)-|-P(72)-l-...P(7n) where the 7i's are all segments on 
the closed trajectory consistent with the macrostate char- 
acterized by the macrovariables whose probability we ask. 
Two consecutive typical segments of durations ri and 
produce a typical segment of duration t\ + T2- However, 
the contrary is not necessarily true: not all pieces on an 
arbitrary decomposition of a typical segment are also, in 
general, typical ones. 

Eg. fTB)) suggests a roughly Hnear dependence of S on 
/ and, in the thermodynamic limit, Eq. (|20p can be 
simplified to 



=S'(7)//fe 



(21) 



where c is a constant. This equation states that seg- 
ments with the highest entropy are also the most proba- 
ble ones. These segments are also the typical ones since, 
on them, the average in Eq. (jlSp coincide with the aver- 
age over the whole trajectory. This is a result of the mean 
value theorem for integrals. Note, finally, the similarity 
of Eq. (pij) and Einstein's inversion formula [l^. The 
latter equation is the basis for Gibbs' variational princi- 
ple (maximum entropy approach) that allows to develop 
equilibrium statistical thermodynamics. 



IV. THE SECOND LAW IN MACROSCOPIC 
SYSTEMS WITH SHORT-RANGE FORCES 

In most macroscopic systems with short-range interac- 
tions the relation between the energy and the action for 
every DOF is Ji = CiS^ where p is a positive exponent 
(and Ci does not depend on energy) and the entropy is 
then 



/ / 
5* = A; In Ci + kp In 

i=l 1=1 



(22) 



At equilibrium, e, = e(^«) = E/f, E = pfkT^'"^^ from 
Eq. (Uni), and 



S'('^«) ^ k\n'[[c^ + fkplne 



(eq) 



(23) 



i=l 



We can use the following mathematical inequality [20| 
(the geometric mean of a series of values £i is lower than 
its arithmetic mean) 



(24) 



then, since p is positive, by comparing Eas. (|22p and 
we obtain that 

> S (25) 



where the equality only holds at equilibrium. Therefore, 
in the evolution to equilibrium AS > 0. This consti- 
tutes the mathematical statement of the second law for 
conservative macroscopic systems with short-range inter- 
actions. 

Thermalization results from the coupling between 
DOFs and leads to the homogeneity required for all ther- 
mal properties at equilibrium. Obviously, no such cou- 
pling is possible in a conservative system with / = 1 , and 
this is always "at equilibrium" . During the relaxation to 
equilibrium, each Ji, e^. Si and S can change with time. 
Whether a system has a state of thermodynamic equi- 
librium or not is determined by the form of the noninte- 
grable part i?i(J, 0) of the Hamiltonian in Eq. ([1]). If it 
vanishes and the DOFs are separated in Hq, the system 
does not have a thermodynamic equilibrium state. The 
dynamical equations are then integrable with / integral 
invariants Ji and the DOFs are not able to exchange en- 
ergy because of the existence of regular orbits. In such 
case the closed trajectory is then only composed of non- 
typical segments. Nonintegrability of the Hamiltonian is 
thus necessary to achieve thermodynamic equilibrium. 

As the system approaches equilibrium the segments 
gradually become typical ones. This process is charac- 
terized by the entropy production a 



dS , 
—r — k 
dt 



din 



(nLr 



J^ 



f 



dt 



1 dHi 



(26) 



where Eq. ([T]) and the Hamilton equations of motion for 
the action variables have been used. At equilibrium S 
becomes S'^'^''^ which does not depend on time, and the 
entropy production vanishes. 

Relaxation to equilibrium is described most easily 
through a term Hi = Y.{=M " in Eq.©, 

with j\'^''^ = Jiie^'^'^'^). This term can be thought to ap- 
pear as a consequence of collisions (or other complex in- 
teractions) that thermalize the system. The Hamilton 

equation Ji = —dHi/ddi = —{Ji — J-'^''^)/Tr, can be 
integrated as J,{t) = (J,o - ''')e-*/^'- + J^'"^\ From 
Ji = CiE^ we have that the energy Si relaxes to e^*^'^ when 

Ji relaxes to Ji'^'^\ and S relaxes then to S'^'^'^K The en- 
tropy production for this Hi can be calculated by means 



of Eq. ([261) as cr 



-t/r,. 



Ef=i(4''^-^«)/J.(t). This 



is a positive definite function which vanishes when equi- 
librium is attained. 

Although relaxation processes can be much more com- 
plex, action-orbit coupling suffices to describe thermal- 
ization in the approach to equilibrium. A relaxation pro- 
cess to a nonequilibrium steady state is illustrated in sec- 
tion IVTl 



V. EXAMPLES 

In this section we consider Hamiltonians which are ei- 
ther integrable or made integrable through suitable ap- 
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proximations based on the dynamics (e.g. the globally 
chaotic system). When equilibrium quantities are men- 
tioned it should be understood that there is an additional 
mechanism in the Hamiltonian producing relaxation to 
equilibrium analogous to the one described in the previ- 
ous section. Here we are only concerned with the inte- 
grable part of the Hamiltonian, from which the relevant 
action-angle variables are obtained. 



C. Planetary system 

Let us consider now a system of N particles of mass 
m moving in closed orbits on the same plane subject 
to a gravitational potential (/ = 2iV). Neglecting the 
interparticle interactions, the Hamiltonian is 



N 




a 



(28) 



A. Noninteracting oscillators 

Consider a system of N noninteracting harmonic 
oscillators (/ — N) with Hamiltonian H = 
{Pif^^ + ''T^^iQi f^): the Ei are related to the am- 
plitude Ai of each oscillator as Si = mujfAf/2. The 
energies Si depend on the initial conditions in which 
the system is prepared. The action variables are Ji = 
Ei/uji and hence p — 1. Eq. (jl6p provides the entropy 
as S = k\n{Yl^^iei/uJi). The equilibrium entropy is 
= A:ln(J|^-^ e^'^'^^ /cui) and the total energy is given 
by Eq.HSl) as £; = NkT'^'"i\ 



where subindex p^j, pej and rj are the radial and an- 
gular momenta and the position of the particle j, re- 
spectively. Each particle has two DOFs of degenerate 
frequencies and their energies cannot be separated. As 
a result, the product of actions in Eq. p6|) run now over 
particles instead of DOFs. The action per particle is 

In this case p — —1/2, 



J. 



Jr,j + Je, 



2^ ^'^'^ the equi- 




the entropy is S* = 2fc In 



librium entropy S'('=«) = 2iVfc In ^a^|j^J . It is to be 

noted that this equilibrium is unstable. The energy 
\s E — —NkT'-'^'^') and the heat capacity is negative, 
C = —Nk. Negative heat capacities arise frequently in 
bound gravitational systems 



B. Classical ideal gas 



The Hamiltonian for a classical ideal gas of N particles 
(/ = 3iV) in a cubic box of volume V — closed by 
adiabatic, rigid walls is 



3N 





2q^ 


-01 




L 





(27) 



where C is an infinitely large constant and O is the Heavi- 
side step-function. The Hill's region for each DOF is just 
a segment with length L and the action variables are 
Ji = 2Ly/2mei, so that p = 1/2. The entropy can be 
easily calculated and the equilibrium entropy is obtained 

from it as 5'(^«) = fcln W'^ (2m£;/3iV)^^/^j which coin- 
cides with the microcanonical one, except for an unde- 
termined constant a like in Eq. ((S]). From Ea. (fT5)) the 
energy is = 3NkT^'"'y2. 

We can group the Ji appearing in the entropy in blocks 
of three factors corresponding to each particle. Permu- 
tations of the blocks cannot be distinguished and, since 
there are A^! of these permutations the constant a should 
be (X 1/A^!. These considerations constitute the explana- 
tion of the Gibbs' paradox. The dependence of the equi- 
librium entropy on extensive variables (iV, V, E) match 
the traditional calculations and other thermodynamic 
variables such as pressure and chemical potential can be 
defined from this entropy p^ . 



D. Globally chaotic system in the adiabatic 
approximation 



Let us consider next a system with / = 2 and H = 
{^p1 + Py + x'^y'^'^ /2. It constitutes a simple model of 
the classical Yang-Mills field. The energies Si are not 
separated in the Hamiltonian due to the coupling term 
x'^y'^ /2. However, the Hamiltonian can be calculated in 
action-angle variables by means of the adiabatic approx- 

2/3 



imation a.s H = 



j2/3 j2/3 
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then S 



k In 



The entropy is 
and the energy is 



37r 

E = 3fcr(''«V2- Hence, although the Hamiltonian of this 
globally chaotic system is complex, the adiabatic approx- 
imation based on the dynamics [2l| allows us to write it 

^ ^ 2/3 

as in Eq. Moreover, the couphng Jx Jy between 
the action variables makes the system to be already ther- 
malized (action variables are not separated in the Hamil- 
tonian) so that under the adiabatic approximation the 
system is always "at equilibrium" . 



E. Calogero Hamiltonians with short range forces 

Finally, we consider a system of N particles in one 
dimension (/ = TV) with nearest-neighbor interactions. 
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periodic boundary conditions and Hamiltonian 

N N-1 

H= iVAy^pj + /i \JViVi+\ cos [v {qi - qi+i)] 



1=0 



+^cr^PjPi+i cos [j/ {qi ~ qN)] 



(29) 



This Hamiltonian belongs to a class of fully integrable 
Calogero Hamiltonians and can be written in action- 



angle variables as H = y^j^ J jUJi where the w^'s are the 
eigenvalues of the inatrix"j2^ 



C 



/O 1 . 
1 1 
.10 1. 
..101 

Va . . 1 0/ 



(30) 



where a dot stands for 0. If C is any hermitian matrix, 
one can construct a wide class of interesting Hamiltonians 
that can be used to model many-particle interacting sys- 
tems with short- and long-range forces (2^ . The entropy, 
equilibrium entropy and energy, S — fcln(J^j Si^i/uji), 



S'-"'''^ = fcln 



and E = NkT^'"i\ co- 



incide with that of N noninteracting harmonic oscillators 
with frequencies uii. 



VI. NONEQUILIBRIUM THERMODYNAMICS: 
ENTROPY PRODUCTION IN A NETWORK OF 
COUPLED OSCILLATORS 



The Kuramoto model [23| (see also [2J| and [25[ for 
excellent reviews) has received great recent interest be- 
cause it provides a simple model for synchronization. 
This model considers a network of oscillators which arc 
coupled harmonically in phase. After a transient, and 
under certain conditions as explained below, a fraction 
of the oscillators in the network become synchronized. 
This means that both the effective frequency of the os- 
cillators and the phase becomes equal, in spite of the 
fact that they have different natural frequencies and they 
start with very different phases [2^ . 

The Kuramoto model is a particular case of the so- 
called phase models [1^ [l^l in which angles are coupled 
through a harmonic function. Every dynamics yielding 
oscillations to a limit cycle can be transformed in a phase 
model by means, for example, of the Hilbert transform 
[2^ . Phase models are naturally linked to action-angle 
descriptions: the phase of each oscillator runs periodi- 
cally on the limit cycle confining the trajectory, and in 
completing each cycle a mechanical action (which is con- 
jugate to the phase) is carried out by the system. In 
our view, the action variables control the thermodynamic 
properties of the system through Eq. p6p and this opens 
the possibility of studying these properties using our for- 
malism. 



The action-angle Hamiltonian yielding the Kuramoto 
dynamics is 



N 



N N 



sm 



^) (31) 



The first term on the r.h.s. describes the uncoupled sys- 
tem of oscillators with natural frequencies uj° while the 
second depends on a global coupling parameter K that 
can be arbitrarily large. The system is nonintegrable be- 
cause of the explicit appearance of the angle variables in 
the second term. This makes every action variable Ji to 
evolve in time. The Hamilton equations of motion are 



J,. 



dH _ 
dH 



N 

!^ + K^smiOj ^ e^) (32) 

N 

KJ,^cos{e.j~ei) (33) 



Eqs. ([32]) constitutes the Kuramoto dynamics. It estab- 
lishes the effective frequency of the i-th oscillator, which 
is driven in phase through the all-to-all coupling. In the 
limit of vanishing coupling K each DOE oscillates with 
its natural frequency and the oscillators are not synchro- 
nized. For K higher than a critical value Kc^ however, 
some oscillators become synchronized after a transient. 
In the limit of strong coupling all oscillators are syn- 
chronized. This situation is depicted in Fig[TJ which 
has been obtained by numerical integration of Eqs. ((32|) 
by employing a fourth order Runge-Kutta algorithm for 
N = 100 oscillators starting at random initial phases and 
with a uniform distribution of natural frequencies in the 
range (0, N] rad/s. The phases of the oscillators converge 
into two branches with the same effective frequency and 
phase. The suitability of the action-angle variables for 
the parameters considered was confirmed in the simula- 
tions by checking Eq. (fT3|) at each time. 

Eqs. represent the dynamics of the conjugate ac- 
tion variables and the entropy production can be calcu- 
lated from Eq. ([26|l as 



N N 



cos 



(34) 



Remarkably, this equation does not depend on the Ji 
and a can be evaluated after numerical integration of 
Eqs.(f32|). If we consider a high number of oscillators, the 
r.h.s of Eq. (j34p vanishes when these are not synchronized, 
since the phases are distributed uniformly. In the limit of 
high coupling all oscillators are synchronized, the phases 
of some oscillators become equal and the r.h.s of Eq. ([Ml) 
becomes approximately ~ KN'^ attaining a finite and 
positive value. This positive sign of the entropy produc- 
tion for networks with many oscillators and long times is 
perfectly consistent with the Second Law of Thermody- 
namics. In Eig. [5] we show the value of the normalized 
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FIG. 1: Time evolution of the phases of 100 osciUators for 
strong couphng K=5 obtained by numerical integration of 
Eqs. (|32p . The system starts with a random distribution 
of phases and after a short transient all oscillators become 
synchronized with the emergence of two branches with the 
same effective frequency. 
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FIG. 2: Time evolution of the normalized entropy production 
(7* = a/[kKN{N—l)] for different networks of oscillators with 
the values of A'^ indicated in the figure and coupling param- 
eter K = 5. The system starts with a random distribution 
of phases and after a short transient all oscillators become 
synchronized. 



entropy production a* = a/[kKN{N — 1)] for different 
network sizes and in the strong coupling limit {K = 5). 
The initial phases are chosen at random. It is observed 
that in the nonequihbrium steady state, when the oscil- 
lators become synchronized, this entropy production is 
positive and finite in all cases. For networks with high 
numbers of oscillators, the entropy production is positive 
at all times in all trajectories starting at random phases. 
For low number of oscillators and small time scales (far 
from the thermodynamic limit), negative entropy pro- 
duction can be observed. 

Another interesting issue concerns the characteriza- 
tion of disorder. The nonequilibrium entropy calculated 
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FIG. 3: Entropy production in the long time limit as a func- 
tion of the coupling parameter for a network of A'' — 100 
oscillators. The entropy production vanishes for coupling pa- 
rameter lower than a critical value around K — 0.55. At 
the onset of synchronization, the entropy production becomes 
positive and finite. In the limit of strong coupling, all oscilla- 
tors are synchronized and the entropy production approaches 
a line with slope ^ . 



above is directly related to the activity of the network 
of oscillators and acts itself as an order parameter of 
the system. In Fig. ^ we show the value of the en- 
tropy production at the steady state = a{t oo) 
as a function of the coupling parameter for a network 
of iV = 100 oscillators. Quite interestingly, the entropy 
production is zero for low values of the coupling param- 
eter in which the oscillators are not synchronized. Then, 
at a critical value Kc around 0.55, the entropy produc- 
tion becomes increasingly positive with increasing cou- 
pling and tends asymptotically to a line with slope ~ N'^ 
at strong coupling. This finite, positive entropy produc- 
tion arises exactly when a fraction of oscillators in the 
network gets synchronized through the coupling. It rep- 
resents the price that we have to pay for getting this 
ordered phase stabilized in time. For coupling param- 
eter below the critical value, the network is disordered 
and there is no dissipation (i.e. the entropy production 
vanishes) . 

When all natural frequencies of the oscillators are equal 
we can prove analytically that the entropy production 
increases in driving the system to the stationary state. 
In this case we have uj° = uj° for all i, and we can change 
the angle variables to 4>i — 9i — uj°t. Eqs. ([5^ read in 
this case as 

dH ^ 
= — = X ^ sm{(j)j - (p,) (35) 

and the entropy production, Eq. p4p . is 

N N 

^=i^^^cos(^,-0.) (36) 
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By comparing Eqs. p5|) and (|36p we observe that 



APPENDIX A: ERGODICITY 



1 f da 



(37) 



and therefore 

da f da\ 1 v-^ I Oa \ „ 

^ = E(^j-^-^E(^j (38) 

which is the result that we wanted to prove. 



VII. CONCLUSIONS AND PERSPECTIVES 

We have shown that thermodynamics can be grounded 
on classical mechanics with the help of the Maupertuis 
principle. In our approach, thermal states are fully char- 
acterized by appropriate action variables. The nonin- 
tegrable part of the Hamiltonian dictates relaxation to 
equilibrium, an evolution driven to an steady state or 
a departure from equilibrium. This approach is consis- 
tent with the Second Law of Thermodynamics for macro- 
scopic systems. The results obtained are, therefore, quite 
general and can be applied to systems with arbitrary size 
both in and out of equilibrium. Although we do not 
make explicit use of probability, it is also shown that the 
latter can be introduced from classical mechanics yield- 
ing an Einstein relationship at the thermodynamic limit. 
The main difficulty in our approach comes from finding 
the appropriate set of action-angle variables from a given 
Hamiltonian. We have shown, however, that in many rel- 
evant cases this is possible provided that a criterion on 
the suitability of these variables (coming from demanding 
a necessary consistency for the definition of the nonequi- 
librium entropy) is satisfied. Our approach has then been 
illustrated by applying it to systems with very different 
physical properties (ideal and globally chaotic systems 
and many-body Hamiltonians with short and long-range 
interactions). The dynamical definitions of thermody- 
namic quantities reproduce previous results derived from 
statistical mechanics. Finally, the relevance and applica- 
bility of our ideas to nonequilibrium situations has been 
illustrated by evaluating the (dynamically-defined) en- 
tropy production of a network of coupled oscillators (Ku- 
ramoto model). This quantity proves to be physically 
meaningful giving a measure of dynamical order. We find 
that its positive value at the steady state is directly re- 
lated to the emergence of an ordered, synchronized phase 
from the collective dynamics of the coupled oscillators. 
This opens the possibility of studying the thermodynam- 
ics of pattern recognition [13, HI] . 
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FEDER under Project No. MAT2005-01441. 



The thermodynamic formalism presented in this pa- 
per does not require ergodicity. However, it embodies 
ergodicity when Birkhoff 's theorem holds. From this the- 
orem (see [i3 p. 286), time averages < ... >t^ coincide 
with phase space averages < ... >r when all frequen- 
cies Ui = dH/dJi are independent. In this case, Eq. 

becomes the statement of the equipartition princi- 
ple and the system is ergodic. We then have fkT^'^'^^ =< 
2K >r,=< 2K >r= f<^{E)/n{E) [3p| where $ = 
/ dre - i7(q, p)] and n ^ / dF^ - i7(q, p)]. 6 
and (5 are the Heaviside and the Dirac delta functions, 
respectively, and dF is the phase space volume ele- 
ment. Since ?L = d^jdE, we find that //cT^-^?) = 
/ (91n<I>/9i?)^^. Taking this expression to Eq. ([7]) we 
obtain {J^)^ = $ and S^-^'i^ = A:ln$. This is the so-called 
(Hertz) volume entropy which is an adiabatic invariant 
[29l . l3l| . Birkhoff theorem does not hold, however, when 
there exists any integral relation between the frequen- 
cies LOi In these cases, Eq. (|15p can depart from 
ergodicity and equipartition. 



APPENDIX B: THE MIXING OF TWO IDEAL 
FLUIDS 

A popular topic in equilibrium thermodynamics is the 
mixing of two ideal fiuids (see [8j for a beautiful explana- 
tion of Boltzmann ideas) . Let us consider two ideal fiuids 
at equilibrium mixed in a container closed by adiabatic 
rigid walls. The particles interact only through elastic 
collisions. This isolated system is depicted schematically 
in Fig. |4] (a) and is composed of pink and black parti- 
cles. We ask now why we do not observe an spontaneous 
departure from this homogeneous mixture leading to a 
separation of both fiuids as represented in Fig. [1] (b'). 

The Maupertuis principle requires that 



f ' pdq = ^2mE5 j ' ds = 



(39) 



where ds is the differential of arc length on the trajectory. 
The last equality states that the trajectory of the motion 
between two points in the configuration space (say (a) 
and (c) in Fig. 3]) is the one with minimal length. We 
now can immediately realize why we do not observe (b') 
starting from (a). The number of points in the trajectory 
in which the system looks macroscopically disordered as 
(a), (b) and (c) is large and points (a) and (c) are con- 
nected through points as (b) and not as (b'), because going 
through intermediate states of disorder as (b ) extremizes 
the abbreviated action. It can be intuitively seen with 
the help of Fig. 3] that, from a mixed state (a), sepa- 
rating pink particles from black particles (b') and then 
mixing them again (c) leads to a longer trajectory than 
passing through intermediate mixed states such as (b). 
Attaining (b') from (a) requires each particle to travel a 
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(a) 




FIG. 4: Two possible trajectories joining the disordered con- 
figurations (a) and (c) of two mixed fluids. The trajectory 
going through (b') is forbidden by the Maupertuis principle 
since it is possible to find disordered configurations (b) be- 
tween (a) and (c) so that the abbreviated action (= the length 
of the trajectory between (a) and (c) in the 3N-dimensional 
configuration space) is a minimum. 



certain distance so that it is then located in the appro- 
priate macroscopic sub volume. This requirement is not 
necessary if the trajectory passes through intermediate 
disordered states such as (b). Each individual particle 
travels now a much shorter distance and so is the total 
length of the trajectory in the 3N-space. By Maupertuis 
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